Conducting Audio Files via Computer Vision
نویسندگان
چکیده
This paper presents a system to control the playback of audio files by means of the standard classical conducting technique. Computer vision techniques are developed to track a conductor’s baton, and the gesture is subsequently analysed. Audio parameters are extracted from the sound-file and are further processed for audio beat tracking. The sound-file playback speed is adjusted in order to bring the audio beat points into alignment with the gesture beat points. The complete system forms all parts necessary to simulate an orchestra reacting to a conductor’s baton.
منابع مشابه
Multimedia Mining
Advances in multimedia acquisition and storage technology have led to tremendous growth in very large and detailed multimedia databases. If these multimedia files are analyzed, useful information to users can be revealed. Multimedia mining deals with the extraction of implicit knowledge, multimedia data relationships, or other patterns not explicitly stored in multimedia files. Multimedia minin...
متن کاملMusical Analysis of Conducting Gestures Using Methods from Computer Vision
We present technical interpretations of a noted conductor’s gestures. These were enabled by Computer Vision techniques that tracked the position of the conductor’s right hand from a video sequence. The output of the hand tracking system, when combined with beat and tempo data from the audio signal, provides many possibilities for analyzing the conductor’s gestures and expressive techniques. We ...
متن کاملAn Overview of Different Approaches for Lecture Casting
Podcasting is a special approach to distribute multimedia (usually audio files) over the internet. Users can subscribe to a particular podcast which is then delivered automatically for replay on their mobile devices (MP3 players, laptops) or desktop computers. Podcasts are not restricted to pure audio files but also include slide shows with synchronized audio replay and video files for mobile m...
متن کاملExploration of Point-Distribution Models for Similarity-based Classification and Indexing of Polyphonic Music
Similarity is an intuitive criterion for indexing and classification of digital audio files in music information retrieval systems. While significant work has been done on similarity-based approaches to monophonic music, methods for reliably dealing with databases of arbitrary polyphonic music remain elusive. In this paper we describe our ongoing research in exploring the use of high-order mult...
متن کاملA Method for Copyright Marking
Previously [1], we demonstrated a method for automated search for query-identical images and their differentiation from the query image closest analogs, based on the previously described nonprobabilistic method for hypothesis generation and verification (HyGV-2D) [2-3] applied to analysis of grayscale (or color) histograms. The HyGV method provides the differentiation between original images an...
متن کامل